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ABSTRACT — 
% This document presents achievement results of a study 
conducted to determine tha effects of diagnostic tests administered 
to provide immediate feedback and to serve an: organizing function in 
the study of ‘course material. Thirty-three first year college 
students in Ficlogy classes comprised, experimental and control 
groups. Results from the first unit taught indicated no significant 
increase in student achievement. With a second unit of instruction, 
however, an increase in student achievement did result for those 
studentg using diagnostic oiganizers. (SL) 
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THE EFFECTS OF DIAGNOSTIC TESTING 
AS AN ORGANIZING. FEEDBACK MECHANISM ON THE ACHIEVEMENT 


OF FIRS YEAR COLLEGE BIOLOGY STUDENTS 


attributed to thi use of the mastery strategy, at the heart of which lies 


amiastncmadictoetng pracess. 


conjunc£ion with objective-specific, diagnostic tests (diagnostic ongan zers) ¢ 
ework difficulties were resolved was left to the student. Self diagnosed 


uld be resolved in any number of ways: further study, student-teacher 


nteraction, additional study of supplementary materials, or any manner in 
‘which a student chose to approach the problem. No specifically prepared 


‘ + ¢ 
remedial assignments were available, however. The main purpose of this study 


was to determine what effects the administration of a diagnostic organizer 


technique would have on student achievement. 


N ‘ 
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PROCEDURE 


Two undergraduate college level Biology classes at the University of 


Georgia formed the experimentally available population for this study. The 


classes, which were in’progress when the study began, were largely composed 
al > " 
‘of female, preservice, elementary science teachers, and were kept intact. No 


, 


* randomization procedure was possible. * os 
The total nymber, of students enrolled in both classes was thirty-three. 


From those, thirty complete data profiles were produced. The experimental 
group was composed of twenty students. The control group was composed of ten 


- ] . Pd Wie 
students. Information Poured derining the total student populatian is located" 
in Table 1. ° ; ‘ 1. 


Diagnostic organizers were administered to the experimental ‘group on 
re y 7 . 
a daily basis, over a three week' period, and through two units of inatruction. 


Both the experimental and control classes:met thyee days a week for a one- 


hundred minute period each day for the duration of that period. 


The diagnostic organizers and unit examination materials were developed 


with the collaboration of both course ifgtructors, to aid iN assuring content 
validity, and probable relfability. A list ‘of the unit objectives on * 
Ecological Interaction, and a diagnostic organizer instrument are contained 
in the Appendix. The unit examination reliability figures are listed in 
Table 2. . | 

Unit objectives were sequenced and grouped sibrceodiog to which would 
be taught during each class period. tisensettic organizers which tested each 
objective were then developed for each group of objectives to be taught during 


a class session. For example, if: three objectives were taught.during a class 
. 


period, then the diagnostic organizer would contain a minimum of three 


questions, with one question. testing each objective. 
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: POPULATION® 


; * " “the @iagnostic organizer was 
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pulatton Defining Mesa Scores. 


ry, COLLEGE 
TOTAL REDIT HOURS 
COMPLETED 


. STUDY : 


(33 students: 
31 female 


2 male) 
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$plit Halves Reliability Figures of ‘Animal. Behavior, 
\ Animal Behavior Retention and Ecological -' 


"Interaction Test Instruments 


+ 


Ecological 


Futwai Behavior 
Interaction: 


© Retention’ 


Animal Behavior 


. ? : ¢ 
composed of three pages: 1) a diagnostic 


The answer key was attached 


‘quiz, 2) a response sheet, and 3) an answer: key 
The students were 


ts : « \ 
to the others such.that it Faced the opposite direction. 
. t. e G 
instructed to use the response sheét to record their answers, -then tear off 
the answer key, turn it over, and compare it with their -own responses They 


were then permitted to make any notes which they felt would benefit themselves. 
’ This process took’ an average of ten minutes Pages one and two were collected, 
and the-class was dismissed.., , : 


ee 


. . ; m : oe . 7 - 4 
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The ingorrect responses were tabulated in order to provide feedback. for 
: . : f . “G & 
the instructor, “however, no papers were graded, and no scores were recorded on 


‘ * 


the bas#s of ‘these tests. At the beginning of the next class period, ‘ten 


‘minutes were available to accommodate student questioning before continuing 


with the next group of objectives. If no questions were raised, the next 
bleck of ,instruction was immediately begun. . 


With the exception of the diagnostic testing procedure, the control 
group received identical-einstruction. The twenty additional minutes (approxi- 
r : 
. ‘ * . 
mately) which the control group passessed were utilized by providing additional 


break time, having. several minutes of additional instructional time, and 7 oe 

dismissing class earlier than required. hea t,t / . 8 
Upon completion of a unit’, the unit Pxamination was administered, The ¢: 

unit examination question-types were identical to those which had been utilized ce y 

in, the diagnostic ‘instrument, and’ had been developed aimuttanesusly with chat, : f 

Both units ‘followed the iyertical summative exathination ideabatin with one 

minor exception. .The data’ collected on the Ecological Interaction unit 


. . 
examination was taken from a larger examination which covered three units of 


instruction, whereas the, Animal .Behavior unit examination covered only that “ye 
P ¢ ; ‘ 5 
unit's work. d ‘ : = ‘ 


' Pre-treatment data aa Ne Scholastic Aptitude Test (SAT) 


scores. These figures were obtdipéd from University of Georgia student records. 


SAT scores, utilized as an indication of general ability, allowed blocking 


. , . 
students into high and low groupings (900 and above = high; below 900 = low), 


This was done to determine if a particular ability group was affected to a 


greatér extent than the other. Data were collected on both unit examinations 


. 


and on a retention examinat fon" covering the Animal Behavior unit. 
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RESULTS 7. 


bog 74 Aen scores for the Animal Behavior “unit examination are given in 


‘Table 3. basen so of these data indicate non-significant treatment effects, 


& 
yet a. signiticnnt treatment x ability interaction (see Table 4). In order 
to cungrbins the’ satis of this intimation: the cell means ‘wer’ graphed as 
a Se Figure v re rn a 
TABLE 3 
Cell, "Bainetunl. and Grand Mean Scores 
- For the aia Behavior Unit Examination 
5 : Ability 
a. Experimental 
We sat TREATMENT , ae 
Control 
\ ; 7 
a 
S 
. TABLE 4 
Analysis of Variance on Animal Behavior 
, 7 Unit Examination Scores = 
eo ; 
Degrees of __; ' :F Significances of 
Sources - Freedom Mean Squares Ratios F Ratios 
Treatment, (T) 1 . 30.032 2.126 0.153 3 , f 
Ability, (A) 9° 1 1.888 © 0,134 0.999 
TxA 1 90.466 . . 6,404: "0.017 


Explained 3 41.057 2.906 0.053 : 


” Residual 26 14.127 ie St 


_ ‘High Low i : 
} oy i 
Figure 1. Treatment X ability interaction of the animal behavior 


* unit examination : 
,. 


Mean scores for the Animal Behavior retention examination are given in 


° 


Table 5. Analysis of these data also fail to indicate any significant treat- 


. a e - 
ment effects (see Table 6). The same type ‘of Treatment X ability interaction 


which odcurred with the Animal Behavior unit examination continued to exist 


within these data. . 


TABLE 5 


Cell, Marginal, and Grand Mean Scores 
For the Animal Behavior Retention Examination 


Ability 


Experimental 
TREATMENT ‘ 
Control 


, 


= TABLE 6° 


Analysis of Variance on Animal Behavior 
» "Retention Examination Scores 


Degrees of F Significances of 
_ Sources Freedom Meary Squares = Ratios F Ratios 


Treatment, (T) 23.590 - 2.033 
Ability, (A) * 0.839 0.072 


TxA 64.354 5.546 


Explained 29.753 2.564 


Residual . 11.604 


Table 7 shows the mean scores on the Ecological Interattion examination. 
| 
The F Ratios indicate significant treatment effects in favor of thesexperi- 
mental group at the .008 level (see Table 8). No treatment X ability inter- 


* action occurs in these data. Also, neither ability group outperformed ‘the 


other to. any significant extent. 


° TABLE 


Cell,. Marginal, and Grand Mean 
Scores for the Ecological Interaction Unit Examination 


Ability 


Experimental 
TREATMENT 
Control 


, 


TABLE 8 


Analysis of Variance on Ecological. 


Interaction Unit Examination Scores oa ae 
en tit 
; P ei ewe ; 
Degrees of _ 3 F | (Significances of’ . 
Sources Freedom Mean Squares Ratios: ,*: . F Ratios 
se ae 
" treatment, (Th 1 151.376. 8.197 7 0,008 
Ability, (A) 1 18.849 . 1.021 | 0.323 
TxA 1 33.653 € 1.822 . 0.186 
Explained 3 69.773 _ 3.778 za 0.022 
> » . Residual 26 . 18.4e7_ as yee ee 
: DISCUSSION 


OWN Fanas 3, 


The dgta collected from the use of didgnostic organizers are conflicting. 


‘ 


In the Animal Behavior unit, the first yritt to be.taught, no significant 
increase in wtudent achievement mice te a result of the use of “e diag- 
nostic organizer technique. In the Ecological Titeraetion unit, however, a 
reversal of those results oqcurred. An increase in student achievement 
signi teat at the .008 level did result for those students who had experienced 
J the use of diagnostic organizers. Perhaps this is an indication that ‘students. 
do not immediately become completely aware of the function and proper usage 


of the diagnostic organizer. Perhaps the acquisition of a particular level * 


of understanding in a.subject area is more positively enhanced through the 


} . 


function performed by diagnostic organizers. : 


The diagnostic organizer serves the function of a continuous organiza- 


he a OS tional tool. Used in conjunction with performance objectives, it's purpose 
ETRE we 7s 


.¥-  -s," is to allow students to pinpoint their difficulties or understandings with 


a 3 . 10 


‘ a ; \. 4 


é 
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regard to the more important (i.e., testable) material presented in the 
classroom. In practice, the use of ateuienhie organizers is: quite simple. 
A set of objectives, and multiple parallel test iets are all the materials 
that are required. 

_ An indication of the success of Lite ciapavisdh tensiiies strategy. has 
been obtained through the results of this Study. If, after further mintdy 
the diagnostic organizer concept proves to be both effective and reliable, 


& - 
then it's simplicity will greatly facilitate it's adoption as a classroom 


teaching strategy. . . V @ 
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‘ _ APPENDIX \ 


ECOLOGICAL INTERACTION 
Performance Objectives «= . | vo 
1 $ e ‘ ‘ \ 
Upon completion of ‘this unit students should be able to: | 
: . ‘ \ ‘ 
] 1. Given an ecosystem, label the components as producers, decomposers, ~ 
primary consumers, or sedondary consumers. ’ . 
a . 
2 Given several food chains, construct. a 5 food web., 


° ‘ 3. Given the components of a foodchain, construct the pyramid of 
energy for that food chain. . 
4. Demonstrate an’ understanding of the interaction of abiotic and 
s biotic components sf an environment by reproducing the ssiiaiiite 
phosphorus, or: nitrogen cycles. 


“GT <2 B, “Design a hypothetical ecosystem in terms of producers, decomposers, 
and consumers. i 


6. Diagram or identify the relationship between biotic potential and 
* environmental “carrying capacity. ve - 


7. When given a list of population limiting factors, classify them as 
‘ density-depehdent or. - density independent. 


8. Recognize or define the following terms in view of ecological 


-relationships: 
: * competition commensalism * parasitism 
> ig i predation mutualism 8 


9. Given any organism, briefly describe its ecological niche. 
10; ° Identify or define ecological succession, and determine the stage 
. of ecological succession which exists in a given biological 
panna 


; * 41, Identify or cite examples of homeostatic mechanisms operative at 
’ the population level of organization within an ecosystem. 


12. Given-an example of a’ situation in which man rapidly changes the Y 
environment, cite or select possible ecological consequences. °° 


12° os 


ae 
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+ BIO105 |. | [A 
. { . ECOLOGICAL INTERACTION--DIAGNOSTIC TEST ‘ ? . ° 
: Objectives 10, 11, 12 : e 


. ‘ de 2 > . 
, Place the letter of the: correct answer in the blank to the left of the 
ein: \ ; 
- ie . . . 
-. re | 
‘ 1. A marshy | which. was once a pond | -can be considered to be: * * 


‘ a. in, the teakliy to middle stages. of succession 
“y b. in the very first stages of succession s 
, , ms c. in the late stages of succession . ~ 
§ , +’ d, an exception to the processes of succession 


‘ 2. If all living things in an area wnt destroyed, which a be the 
. first to reappear? : 


2 “a. oaks or maple trees | c. small animals 
° » b. grasses d. cactus or lizards 
, eo ; 
; 7 P 
‘x... List $§ axanples 3 homeostatic mechanisms operative at the population level of 
| organization within an ecosystem. ' 


‘ os rr . . : 
’. « 4, > ‘ ‘ 5 e 
5 


_ 6. What are,several possible’ ecological consequences which could result from 
\ the. building of a dam? A 
| . 

} 
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“BIO 105 * . Se ‘ 
wits -ECOLOGICAL ae a oe TEST ANSWER SHEET 
. Objectives 10, 14, 12° . 


. 


“DIRECTIONS: Please use this sheet to record your answers to the diagnostic i, 
' quiz questions. DO NOT WRITE ON THE QUIZ ITSELF. When you finish 
the quiz, check your answers with the correct answers on the third 
page. You may make any notes that you wish to make on page: three. 
Before you ‘leave class, tear off ‘page three and keep it to study 


‘ , by. 
Z A ' : 
OBJECTIVE X 
1 = 
2 
OBJECTIVE XI « . . 3 
m 5 * . \ Q. 7 
OBJECTIVE XII : : m= . 
. oe F3 e . ° . $53 ' | 
@- * bg ‘ * 
: ‘ A 
: al 
“a ‘ 
e ” m .? 
e a . 
o i 7 } . . * " 
, . ° ‘ 4 - Py + 
as s ; : 
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ECOLOGICAL INTERACTION--DIAGNOSTIC TEST ANSWER SHEET e 
Objectives 10, 11, 12 


? 


‘DIRECTIONS: .Please use this sheet to record your answers to the diagnostic 


quiz questions. DO NOT WRITE ON THE QUIZ ITSELFs When you finish 
* the quiz, check your answer's with the correct answers on the third 


page. - You may pake any notes that you wish to make on page fhree. 
Before. you leave class, tear off page three afd keep it to stydy 
by. ae é 

OBJECTIVE X° 


A 
B 


‘OBJECTIVE XI 


3 COMPETITION . 
4 PARASITISM 
5 PREDATION 


OBJECTIVE XII 


6 flooding of an area in an advanced stage of succession 
situation 
modification of water temperature 
upsetting of the migratory paths of land animals and fish 
®. . : ’ 
* . 
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